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Background: The increasing problem of multi-drug-resistant (MDR) tuberculosis (TB) [ie resistant to at least 
isoniazid (INH) and rifampicin (RIF)] is becoming a global problem. Successful treatment outcome for MDR-TB 
depends on reliable and accurate drug susceptibility testing of first-line and second-line anti-TB drugs. 

Method: Consecutive M. tuberculosis isolates identified as MDR-TB during August 2007 to January 2008 using the 
BACTEC MGIT 960 systems and the agar proportion method were included in this study. Susceptibility testing of 
MDR-TB isolates against ethambutol (EMB) and streptomycin (STR) as well as two second-line anti-TB drugs, 
kanamycin (KAN) and ofloxacin (OFX) was performed using the BACTEC MGIT 960 systems at a routine diagnostic 
laboratory. The results were compared to those obtained by the agar proportion method. 

Result: The agreement between the BACTEC MGIT 960 system and the agar proportion method was 44% for EMB, 
61% for STR and 89% for both KAN and OFX. The sensitivity and specificity of the BACTEC MGIT 960 system using 
the agar proportion method as a gold standard was 92% and 37% for EMB, 95% and 37% for STR, 27% and 97% for 
KAN and 84% and 90% for OFX, respectively. 

Conclusions: The BACTEC MGIT 960 system showed acceptable sensitivity for EMB, STR, and OFX; however, the 
BACTEC MGIT 960 system was less specific for EMB and STR and demonstrated a low sensitivity for KAN. The lower 
agreement found between the two methods suggests the unreliability of the BACTEC MGIT 960 system for the 
drugs tested. The reasons for the lower agreement between the two methods need to be investigated and further 
studies are needed in this setting to confirm the study finding. 
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Background 

Drug-resistance remains a serious threat to tuberculosis 
(TB) control programmes worldwide. South Africa is 
one of the high-burden multi-drug-resistant (MDR) TB 
[ie resistant to at least isoniazid (INH) and rifampicin 
(RIF)] countries in the world [1]. The emergence of ex- 
tensively drug-resistant (XDR) TB [ie MDR-TB with 
additional resistance to any fluoroquinolone (FLQ) and 
to at least one of the three injectable second-line drugs: 
amikacin (AMK), kanamycin (KAN) and/or capreomycin 
(CAP)] is worsening the drug-resistance problem [1,2]. 
The World Health Organization (WHO) estimates that 
10.5% of MDR-TB cases in South Africa are XDR-TB 
[1]. 

Standardised, rapid and accurate drug susceptibility 
testing (DST) methods for first-line and second-line 
anti-TB drugs is important to determine an effective 
treatment regimen and to decrease transmission. Various 
susceptibility testing methods are currently available es- 
pecially for first-line anti-TB drugs [3,4]. However, the 
accuracy of these methods are reported to vary accord- 
ing to the anti-TB drug being tested [5]. Drug suscepti- 
bility testing for rifampicin (RIF) and isoniazid (INH) is 
most accurate, but less reliable and reproducible for 
streptomycin (STR), ethambutol (EMB) and pyrazina- 
mide (PZA) [4-6]. Inconsistent results are a common oc- 
currence [7]. This is particularly true in the case of EMB 
resistance as the diagnostic breakpoint (5 to 7.5 ug/ml) 
is close to the Minimal Inhibitory Concentration (MIC) 
of EMB and true resistance may therefore be missed [7]. 

Second-line DST is less standardised and not as simple 
as DST for first-line ant-TB drugs [5]. This is mainly due 
to in-vitro drug stability, varying drug potency and the 
critical concentration defining resistance is often close 
to the MIC [4,5]. These factors increase the probability 
for misclassification of susceptibility or resistance and 
leading to poor reproducibility of DST results [4,5]. 

Therefore, it is recommended to determine in vitro 
criteria, which could be used to predict clinical resist- 
ance and susceptibility with acceptable accuracy, by test- 
ing representative number of clinical isolates [4,5]. 
Although for several years the recommended methods 
for DST were conventional methods on solid media, 
these methods are slow and take a minimum of 3 to 
8 weeks before results are available [8,9]. Susceptibility 
results had to be reported within 4 weeks of specimen 
receipt [10]. The WHO recommends the use of liquid 
media for culture and DST in middle- and low-income 
countries to improve diagnosis of MDR- and XDR-TB 
[11,12]. The BACTEC MGIT 960 system (Becton Dick- 
inson Microbiology System, Sparks, NV, USA) is cur- 
rently regarded as an excellent method able to provide 
rapid and reliable results of susceptibility testing [11,12]. 
The BACTEC MGIT 960 system is an automated, 



continuously monitoring system, based on the detection 
of bacterial growth in drug-containing media which is 
compared with a drug-free control tube [13]. Drug sus- 
ceptibility kits are available for the testing of INH, RIF, 
EMB, STR and PZA [13]. The BACTEC MGIT 960 sys- 
tem has been evaluated for the detection of resistance to 
first-line anti-TB drugs against the standard proportion 
method and the BACTEC 460 TB system and has shown 
a sensitivity of 100% for RIF and INH and a specificity 
ranging from 89% to 100% [14-17]. 

The BACTEC MGIT 960 system was also evaluated 
for DST of second-line anti-TB drugs and critical con- 
centrations for second-line drugs has been established 
[18-21]. The BACTEC MGIT 960 system has shown 
good concordance with the standard proportion method 
[15-18]. Currently, there is no commercially available kit 
for performing DST of second-line anti-TB drugs using 
the BACTEC MGIT 960 system [20,21]. This is incon- 
venient because the working solutions of each drug 
should be prepared by the users, making these tests 
more error-prone due to procedural inaccuracies. Test- 
ing for second-line anti-TB drugs should be precise and 
quality controlled using the reference M. tuberculosis 
H37Rv strain and resistant M. tuberculosis strains. 

The aim of the study was to determine the reliability 
and accuracy of the routine susceptibility testing of 
EMB, STR, KAN and OFX at a high-throughput diag- 
nostic laboratory in a high-burden setting. The suscepti- 
bility results of MDR-TB isolates using the BACTEC 
MGIT 960 system (Becton Dickinson, Sparks, Md, USA) 
were compared against the agar proportion method. 

Results 

Routine DST results for STR and EMB using the BAC- 
TEC MGIT 960 system were available for all the MDR- 
TB isolates, however, only 205 MDR-TB isolates; had 
results for second-line anti-TB drugs (OFX and KAN). 
The results of the routine DST using the BACTEC 
MGIT 960 system were compared to the results 
obtained by the agar proportion method. The results are 
summarized in Table 1. The mean time to obtain sus- 
ceptibility testing results for resistant isolates with the 
BACTEC MGIT 960 system was 6 days, with a range of 
5 to 14 days whereas the agar proportion method was 
11 days, with a range of 7 to 21 days. 

The prevalence of resistance using the BACTEC 
MGIT 960 system and the agar proportion method was 
as follows: 76% (262/343) and 42% (145/343) for STR, 
67% (229/343) and 14% (47/343) for EMB, 2% (5/205) 
and 13% (27/205) for OFX and 5% (11/205) and 11% 
(22/205) for KAN, respectively. A total of 3% (6/205) 
MDR-TB isolates met the criteria for classification as 
XDR-TB according to the BACTEC MGIT 960 system 
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Table 1 Susceptibility testing results obtained with the BACTEC MGIT 960 system and the agar proportion method 



Drug No of isolates Both S Both R MGIT 960 R, proportion S MGIT 960 S, proportion R Agreement (%) 



STR 


343 


74 


138 


124 


7 


61 


EMB 


343 


110 


43 


186 


4 


44 


OFX 


205 


171 


5 


1 


22 


89 


KAN 


205 


178 


6 


5 


16 


89 



S = Susceptible; R = Resistant, STR = Streptomycin, EMB = Ethambutol, OFX = Ofloxacin, KAN = Kanamycin. 



and 7% (15/205) according to the agar proportion 
method. 

The agreement between the BACTEC MGIT 960 sys- 
tem and the agar proportion method was 61% for STR 
and 44% for EMB and 89% for OFX as well as KAN 
(Table 1). The K values are shown in Table 2. The sensi- 
tivity and specificity of the BACTEC MGIT 960 system 
was 95% and 37% for STR, 91% and 37% for EMB, 84% 
and 90% for OFX, 27% and 97% for KAN, respectively 
(Table 2). 

Discussion 

The study describes the performance of BACTEC MGIT 
960 system for testing of MDR-TB isolates against EMB, 
STR, KAN and OFX in a routine diagnostic laboratory. 
According to WHO recommendations, additional testing 
for the remaining first-line anti-TB drugs and second- 
line anti-TB drugs should be done once MDR-TB has 
been confirmed [22]. Reliable and accurate susceptibility 
testing of first and second-line anti-TB drugs is essential 
in order to determine an effective treatment regimen of 
MDR-TB and to avoid further development of resistance 
[1,23]. The accuracy of susceptibility testing results var- 
ies with the drug tested as well as with the method of 
drug susceptibility testing used. In this study the per- 
formance of the BACTEC MGIT 960 system for routine 
DST of MDR-TB isolates was compared against the agar 
proportion method using Middlebrook medium. 

The BACTEC MGIT 960 system performed well for 
STR and EMB when compared to the agar proportion 
method (sensitivity in detecting resistance, 95% and 92%; 
respectively); although the specificity was low for both 
drugs noting that we had a large number of strains 
tested. This finding could be due to a number of factors. 
It is known that specificity can be affected by technical 
errors, such as transfer of TB-bacilli from positive to 



negative samples. It should be remembered that the 
BACTEC MGIT 960 system was done in a high 
throughput routine setting, while the proportion method 
was done in a research facility. Differences in the 
medium composition or technical differences in the pro- 
cedure used for growth measurement between the two 
methods could also affect specificity. In addition, the 
MIC distributions can vary depending on the suscepti- 
bility testing method used as well as the geographic set- 
ting and the prevalence of these strains. It has been 
reported that the susceptibility of M. tuberculosis to 
EMB, STR and PZA is less reliable and reproducible 
using solid medium [24-26]. Among the supranational 
reference laboratories of the WHO, the accepted mini- 
mum performance level (the proportion of concordant 
results) for the testing of susceptibility to STR and 
EMB is only 92% (26). Especially the susceptibility test- 
ing of EMB has long been a challenge for diagnostic la- 
boratories. Discrepancies have been reported when 
comparing results obtained in liquid versus solid media 
[26-29]. 

The performance of BACTEC MGIT 960 system for 
OFX (84% sensitivity and 90% specificity) was within the 
range to that reported previously by Devasia et al. [30], 
where M. tuberculosis isolates from culture-confirmed 
TB patients from 2002 to 2007 were tested for OFX 
resistance by proportion method and BACTEC MGIT 
960. The reported sensitivity for OFX was 83% to 
100%, although the specificity was higher (99.5% to 
100%) when compared to this study. The sensitivity 
in detecting resistance to KAN were considerably 
lower (27%), whereas the specificity was excellent 
(97%). Previous studies reported higher sensitivity 
values (90% to 100%) for KAN [31,32]. This could 
be due the poor standardisation of second-line anti- 
TB drug testing. 



Table 2 Performance of the BACTEC MGIT 960 system when compared to the agar proportion method 



Drug 


No of isolates 


Sensitivity (%) 


Specificity (%) 


PPV (%) 


NPV (%) 


k -Value 


STR 


343 


95 


37 


53 


91 


0.29 


EMB 


343 


92 


37 


18 


96 


0.11 


OFX 


205 


84 


90 


18 


99 


0.282 


KAN 


205 


27 


97 


bb 


92 


0.314 



STR = Streptomycin, EMB = Ethambutol, OFX = Ofloxacin, KAN = Kanamycin. 
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The values of positive predictive value (PPV) and 
negative predictive value (NPV) vary markedly with the 
prevalence of the disease in a given community. In this 
study, the PPV for STR, EMB and OFX were low, indi- 
cating the BACTEC MGIT 960 system could not be 
used in the study setting. However, the PPV of a test is 
primarily affected by the specificity; i.e., the lower the 
specificity the lower the PPV of a test will be. The PPV 
in this study may be further decreased due to the nature 
of the study population. In this study only MDR-TB 
strains were used which changes the pre-test probability. 
The strain difference may also affect test performance. 
In high-burden TB courtiers such as South Africa, sensi- 
tivity needs to be high to reach a good NPV. Countries 
with low prevalence, specificity needs to be very high; 
otherwise the PPV of a test will be poor. 

In this study the performance of the BACTEC MGIT 
960 system were generally lower than those obtained by 
other investigators. Previous evaluation studies for 
MGIT 960 system for testing first-line anti-TB drugs in- 
cluding multicenter studies reported excellent perform- 
ance especially for RIF and INH [14-16,18]. Excellent 
agreement was also reported for second-line anti-TB 
against the proportion method [33,34] or broth-based 
methods such as colometric methods [35]. The MGIT 
960 system is currently recommended by the WHO as 
the gold standard for second-line DST [36]. In case of 
first-line anti-TB drugs, the WHO recommends the 
use of both the BACTEC MGIT 960 system and the 
line-probe assay for testing [37]. However, confirmation 
of MDR-TB by conventional solid-based DST is 
still regarded as the gold standard for first-line anti-TB 
drugs [37]. 

The lower performance of MGIT 960 in this study 
when compared to the agar proportion method could be 
due to the presence of borderline resistant M. tubercu- 
losis strains, mainly in relation to the agar proportion 
method where the final results depend on an accurate 
count of colonies [22]. In addition, the critical drug con- 
centration defining resistance for EMB and second-line 
drugs is often very close to the MIC required to achieve 
antimycobacterial activity, increasing the probability of 
misclassification of susceptibility or resistance, and lead- 
ing to poor reproducibility of DST results. The discord- 
ance between the BACTEC MGIT 960 system and agar 
proportion method might possibly be overcome by 
adjusting the critical drug concentrations used. In 
addition, the use of two concentrations (low and high) 
for these drugs may reduce false resistance. 

A limitation of the study was the lack of resolution of 
the discrepant results between the BACTEC MGIT 960 
system and the agar proportion using DNA sequencing. 
However, this study provides a routine testing scenario 
where sequencing is rarely available. 



Conclusion 

The BACTEC MGIT 960 system showed acceptable sen- 
sitivity for EMB, STR, and OFX; however, the BACTEC 
MGIT 960 system was less specific for EMB and STR 
and demonstrated a low sensitivity for KAN. The lower 
agreement found between the two methods suggests the 
unreliability of the BACTEC MGIT 960 system for the 
drugs tested. The reasons for the lower agreement be- 
tween the two methods need to be investigated and fur- 
ther studies are needed in this setting to confirm the 
study finding. 

Methods 

Study design 

This study was a descriptive study comparing the per- 
formance of the BACTEC MGIT 960 system with the 
standard agar proportion method for susceptibility of 
first and second-line anti-TB drugs. The diagnostic per- 
formance such as: sensitivity, specificity and predictive 
values were calculated using the agar proportion method 
as gold standard. 

Specimens 

The study was conducted using consecutive M. tubercu- 
losis isolates identified as MDR-TB during August 2007 
and January 2008 by routine DST using the BACTEC 
MGIT 960 system (Becton Dickinson, Sparks, Md, 
USA) at the National Health Laboratory Service 
(NHLS) laboratory, University of Limpopo (MEDUNSA 
campus). The NHLS laboratory is a high-throughput 
routine diagnostic microbiology laboratory that receives 
specimens for culture and DST from the attached Dr 
George Mukhari Hospital and the surrounding clinics 
and hospitals in Gauteng as well as the referring pro- 
vinces of Limpopo, Mpumalanga and North-West. All 
the MDR-TB isolates were tested by the agar propor- 
tion method. 

Routine culture and drug susceptibility testing 

Routine drug susceptibility testing for EMB, STR, KAN 
and OFX was done by NHLS laboratory using the BAC- 
TEC MGIT 960 system. Susceptibility testing for EMB 
and STR was done as part of the MGIT AST SIRE kit 
(Becton Dickinson, Sparks, Md., USA) as described in 
the MGIT DST package insert [13]. For KAN and OFX, 
the standard operating protocol for DST of second-line 
anti-TB drugs from the NHLS was followed, with critical 
concentrations showed in Table 3. The drug susceptibil- 
ity testing results were collected from the NHLS data- 
base. Isolation of the recovered mycobacterial isolates 
from the clinical specimens was performed using the 
BACTEC MGIT 960 system. The isolates were identified 
as M. tuberculosis using Ziehl-Neelsen (ZN) staining and 
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Table 3 Drug concentrations used for the BACTEC MGIT 960 system and the agar proportion method 



Drug BACTEC MGIT 960 system (ug/ml) Agar proportion method (ug/ml) 

STR 1 2 

EMB 5 7.5 

OFX 1 2 

KAN 5 5 



STR = Streptomycin, EMB = Ethambutol, OFX = Ofloxacin, KAN = Kanamycin. 

were confirmed with the Accuprobe method (Gen- 0.21 to 0.4, fair; 0.41 to 0.6, moderate; 0.61 to 0.8, good; 
Probe, Inc, San Diego, California). > 0.81, excellent [39]. 



Drug susceptibility testing using the agar 
proportion method 

All MDR-TB isolates were sub-cultured on Middlebrook 
medium prior to testing. Drug susceptibility testing of 
MDR-TB isolates using the agar proportion method was 
done for two first-line (EMB and STR) and two second- 
line drugs (KAN and OFX). The agar proportion method 
was performed on Middlebrook 7H11 medium accord- 
ing to the Clinical and Laboratory Standards Institute 
(CLSI) procedures and recommended critical concentra- 
tions (Table 3) [38]. Briefly, six-welled Petri plates of 
Middlebrook7Hll medium (TB Diagnostic Services, 
South Africa) was used. Two quadrants in each plate 
contained drug-free medium, one was used as the pro- 
portional control and the other was used as a quality 
control. Fully susceptible M. tuberculosis H37Rv refer- 
ence strain and a known MDR M. tuberculosis isolate 
were used as quality controls. The other four quadrants 
contained the drug concentrations (Table 3). Each quad- 
rant was inoculated with a standard inoculum of 0.1 ml 
of mycobacterial suspension and the inoculum was dis- 
tributed by tilting the plate. An aliquot of 0.1 ml of the 
1:100 dilutions was used to inoculate the proportional 
control. The plates were sealed in a plastic bag and incu- 
bated at 37 °C. The plates were examined 7, 10, 14 and 
21 days of incubation. An isolate was classified as resist- 
ant when the colonies on the drug-containing quadrant 
were more than 1% compared to the colonies present 
on the drug-free control quadrant. An XDR-TB was 
defined as MDR-TB with additional resistance to KAN 
and OFX. 

Analysis 

The results were expressed as percentages. The agree- 
ment, sensitivity, specificity, positive and negative pre- 
dictive values of the BACTEC MGIT 960 system 
compared to the agar proportion method, the gold 
standard, were calculated for EMB, STR, KAN and OFX. 
The agreement between the two methods was deter- 
mined by the kappa (k) statistic. The k value, a measure 
of test reliability, was interpreted as follows: < 0.2, poor; 
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